Extending Karger's randomized min-cut Algorithm for a 
Synchronous Distributed setting 



Shine S 
Dept. of Computer Science 
and Engineering 
College of Engineering 
Trivandrum 
Kerala, India 
shine@cs.cet.ac.in 

ABSTRACT 

A min-cut that separates vertices s and t in a network is 
an edge set of minimum weight whose removal will discon- 
nect s and t. This problem is the dual of the well known 
s — t max-flow problem. Several algorithms for the min-cut 
problem are based on max-flow computation although the 
fastest known min-cut algorithms are not flow based. The 
well known Karger's randomized algorithm for min-cut is a 
non-flow based method for solving the (global) min-cut prob- 
lem of flnding the min s — t cut over all pair of vertices s,t in 
a weighted undirected graph. This paper presents an adap- 
tation of Karger's algorithm for a synchronous distributed 
setting where each node is allowed to perform only local 
computations. The paper essentially addresses the techni- 
calities involved in circumventing the limitations imposed by 
a distributed setting to the working of Karger's algorithm. 
While the correctness proof follows directly from Karger's 
algorithm, the complexity analysis differs significantly. The 
algorithm achieves the same probability of success as the 
original algorithm with O(mn^) message complexity and 
0{n^) time complexity, where n and m denote the number 
of vertices and edges in the graph. 

Categories and Subject Descriptors 

[Distributed Algorithms]: Metrics — complexity measures; 
[Graph Theory]: Miscellaneous 

General Terms 

Network-flow 

Keywords 

Max-flow, Min-cut 

1. INTRODUCTION 

The problem of computing the minimum-cut in a weighted 
graph has been classically studied in literature as the dual of 
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the well known max-flow problem for networks ^ and clas- 
sical solutions to the max-flow problem were used to solve 
the min-cut problem. These algorithms could be classified 
as those based on augmenting paths 13] , improvements to 
the augmenting path approach based on blocking flows |3llT2] 
and those based on pre-flow method introduced by Goldberg 
and Tarjan[6]. The best known algorithms for the max-flow 
problem are based on the preflow approachjlj 1171 [7]. The 
max-flow problem also has been recently studied in a dis- 
tributed setting in 2]. 

Further investigations revealed that there are more efficient 
direct solutions to the min-cut problem (without solving 
max-flow and taking the dual). Nagamochi and Ibaraki[T5] 
published the first deterministic global minimum cut algo- 
rithm that is not based on fiow, but was rather compli- 
cated. Stoer and Wagner [16] presented a simple determin- 
istic global minimum cut algorithm which runs in 0(mn + 
log n). 

Karger[S] presented the first randomized global min-cut al- 
gorithm which runs in 0{mn^\og^ n). The running time of 
a single trial of the algorithm is 0(m log^ n). The algorithm 
has to be repeated log n times to achieve a high success 
probability of 1 — ^. Karger and Stein[9] further improved 
its running time to 0{n^ log'' n) for the same probability. 

Recently there has been revived interest in the min-cut prob- 
lem owing to its applications to network coding and wireless 
sensor networks [151 1101 114j . Sensor networks operate in a 
distributed setting and motivates a solution to the problem 
in a distributed setting. 

In this paper, we show how Karger's algorithm's] can be 
adapted to efficiently solve the min-cut problem in a dis- 
tributed setting. We assume a very general model of a 
graph where each node knows only information about its 
neigbours. It is assumed that the storage capacity of a node 
is bounded linearly in the size of the number of its neigbours 
and the computing capacity of a node is bounded polyno- 
mially in the number of its neighbours. The assumption is 
reasonable as each node must have storage and processing 
capacity sufficient to keep track of communication with its 
neighbours. The nodes can perform local computations and 
can communicate only with its neighbours along the edges 
of the graph. Our objective is to find the value of the global 



min-cut and communicate the same to all the nodes. More- 
over, each node must know which among the edges incident 
on it are present in the min-cut computed. While the cor- 
rectness proof follows directly from Karger's algorithm, the 
complexity analysis differs significantly. We show that for a 
graph of n vertices and m edges, the algorithm computes the 
global min-cut with probability atleast 1 — ^ with O(mn^) 
message complexity and 0{n^) time complexity when there 
is a global clock for synchronization. We note that although 
the assumption of a global clock may be impractical in appli- 
cations like sensor networks, there are standard techniques 
for converting synchronous distributed algorithms to asyn- 
chronous algorithms, with some loss in computational effi- 
ciency [11]. We pursue the simpler synchronous setting here 
as it allows a less cumbersome presentation of the algorithm 
and a simple analysis. 

2. THE ALGORITHM 

2.1 A Brief Description 

Assume that given a weighted graph G — {V, E, w) where 
E C V xV and w : E ^ U {0} is given(We use the terms 
network and graph interchangeably). In our algorithm Nu 
represents the neighbourhood of vertex u, weighty repre- 
sents the present edge weights of Nu, that is, for each v £ 
NujWeight^i^u] indicates the weight of edge (u,v). rank^[v\ 
is the rank of edge (u,v), a random number which is uni- 
formly chosen between 1 and m''(for some fixed A; > 5), 
on each trial, maxrank represents the maximum value of 
rank among all the edges. Initially maxranku is defined 
as the maximum rank of the edges connected to vertex u. 
The algorithm sets maxrank = MaXu£V(G)''naxranku- The 
status of a vertex may be ACTIVE or INACTIVE (ini- 
tially ACTIVE), statusu = INACTIVE if all neighbour- 
ing edge weights of vertex u are 0, which means that vertex 
cannot initiate the contraction process. We call an edge 
active if at least one of its end points is active. 

The algorithm proceeds by simulating edge contractions as 
in[8], by collecting vertices joined together by contraction 
into vertex groups. Edges within a group are inactive as 
they cannot be further contracted. At each step, an active 
edge of maximum rank is chosen for contraction. Since edge 
ranks are assigned uniformly at random, each active edge 
has equal probability for getting contracted. The algorithm 
continues contractions till only two vertex groups remain 
and the set of edges across the two groups is chosen as the 
mincut for that trial. The smallest cut found in log n 
trials will be the mincut with probability 1 — ^. 

The variable lastmsgu stores the last message received at 
vertex it (used to reduce message fiooding) and the boolean 
variable stopu is set to true when only two vertex groups are 
remaining and no more contraction can be made, and set to 
false otherwise. 

The variable gu represents the present group id of vertex u, 
initially gu ~ u. Initially there are n groups, one for each 
vertex. As contractions progress, the number of groups re- 
duces and we set weightu [v] = if ~ gv and weightu [v] 
otherwise. The following description presents a high level 
view of the algorithm. 

2.2 Details of the Algorithm 



Algorithm 1 distributed-mincut-in-a-nutshell() 

assign a rank (between 1 and m*^) to each non-zero 
weighted edge. {Algorithm UJ- 

At each node u of the network execute the following: 
find maxranku of each vertex u locally. {Algorithm [SJ- 
find the vertex a;(with largest vertex id) having the max- 
imum value of maxrank. {Algorithms [6l ITU }- 
if there are only two groups then {Algorithms [T] (3] 1151 
[T61 I2TI - 

compute local mincut mc„ by summing the non-zero 
edge weights of vertex u. 1 Algorithm I10|i - 
compute global mincut by summing up all local min- 
cuts. {Algorithms [TT] mi- 
broadcast the mincut to all nodes and stop. {Algo- 
rithms [H [231^ 
else 

contract two vertex groups by making the edge weights 
between them zero and group ids equal to the value of 
maxrank (The contraction process is initiated by the 
vertex a;). I Algorithms [71 151 
repeat the algorithm 
end if 



Each node in the network executes Algorithm [2] described 
below. Here, the function initializeQ initializes the group id 
of each vertex with its vertex id. The function assign-rank{) 
assigns a rank to each non-zero weighted edge with in the 
network, with a random value between 1 and m'° . The time 
complexity for this function is 0(n). The function find- 
local-maxranki) computes the maximum rank within its 
neighbourhood, with time complexity 0{n). The function 
find-global-maxranki) computes the maximum of all the 
local-maxranks within the network, with time complexity 
0(n) and message complexity 0{ran). 

The function check-eligibility-and-contract{) checks whether 
there are more than two groups within the network and if so, 
contracts two groups by making all the edge weights between 
them zero and their group ids the same. This can be accom- 
plished with time complexity 0(n) and message complex- 
ity 0(m). The function check-termination-statusQ checks 
whether there are only two groups within the network and 
if so, invokes mincut computation and halts, otherwise the 
algorithm is repeated. This can be accomplished with time 
complexity 0(n) and message complexity 0(m). All the 
above mentioned functions except initializeQ has to be re- 
peated n — 2 times. 

The function find-local-mincut() computes the sum of edge 
weights within its neighbourhood, with time complexity 0(n). 
The function find-global-mincut{) computes the the sum of 
all local-mincuts within the network, with time complexity 
O(n^) and message complexity 0{mn). Node u messages to 
node u -|- 2*~^ in step i, for i £ {1, ... logn} to ensure that 
the messages propagate to all nodes in O(n^) time with only 
0(mn) messages. The function broadcast-mincutQ broad- 
casts the computed mincut value to all the nodes within the 
network, which is done with time complexity 0{n) and mes- 
sage complexity 0{m). The function synchronize^ allows 
the nodes to wait for some time so that the same instruction 
can be executed by each node, in the next time step. This 
function waits for 0{n) steps. 



Algorithm 2 distributed-mincut() //To be executed at 
each node 

initiahzeO 

repeat 

assign-rank() 
find-local-maxrank() 
find-global- maxrank ( ) 
synchronize 

check-eligibility-and-contract 

synchronize 

check-termination-status() 

synchronize 
until stopu ~ true 
find-local-mincut 
find-giobal-mincut ( ) 
synchronize() 
broadcast-mincut ( ) 



Algorithm 3 initializc() 



Algorithm 4 assign-rank() 

{Rank of an edge to be assigned by higher numbered end- 
point} 

for each v G Nu do 
if u > V then 

if weightu[v] ^ then 

ranku\v\ <— a random number between 1 and m'° 
else 

ranku[v] <— 
end if 

send(SET-RANK, ranku[v]) to v. {See AlgorithmfTSl 
for receipt of message} 
end if 
end for 



Algorithm 5 find-local-maxrank() 



Algorithm 6 find-giobal-maxrank() 

send(FIND-MAX-RANK, maxrank^) to each v £ Nu- 
{See Algorithm 1 141 for receipt of message} 



Algorithm 7 check-cligibility-and-contract() 
stopu true 

if maxranku = maa;„gjv^ (ranfeu [n]) and u > v then 
if 3k; £ Nu with weightu[w] ^ and v w and g^ ^ 
g^j then 

stopu <— false 

contract 
else 

send(IS-ELIGIBLE-CONTRACT, u, gu, gv) to each 
X £ Nu- {See Algorithm 1151 for receipt of message} 
end if 
end if 



Algorithm 8 contract () 

if maxranku = maXusNu{ranku[v]) and u> v then 
weightu[v] •<— 
check-active() 
gu maxranku 

send(SET-GROUP-ID, gu, gv, maxranku) to each x £ 
Nu with weightu[x] = 0. {See Algorithm 1171 for receipt 
of message} 
end if 



Algorithm 9 check-termination-status() 

send(STOP, stopu) to each x £ Nu- {Sec Algorithm [211 
for receipt of message} 



Algorithm 10 find-local-mincut () 
if statusu = ACTIVE then 

"ic„ ■;— l]„gjv„ weightuiv] 
else 

mcu <— 
end if 



Algorithm 11 find-global-mincut() 
for j 1 to logn step by 1 do 

for j ^ 2'"^ to n - 1 step by 2' do 
if w = j then 

send(LOCAL-MC, mc„, u, mm{u + 2'~^, n)) to 
each V £ A'^„. {See Algorithm 1221 for receipt of 
message} 
end if 
synchronize 
end for 
end for 



Algorithm 12 broadcast-mincut () 
if u — n then 

mCu -S— mCu/2 

send(MINCUT, mCu, u) to each v e Nu- {See Algo- 
rithm [53] for receipt of message} 
end if 



Algorithm 13 upon receipt of (SET-RANK, num) msg 

from w 

ranku[w] num 



Algorithm 14 upon receipt of (FIND-MAX-RANK, m) 
msg from w 

{find maximum rank among all vertices} 

if m > maxranku then 
maxranku m 

send(FIND-MAX-RANK, m) to each v £ Nu where 
V ^ w 
end if 



Algorithm 15 upon receipt of (IS-ELIGIBLE- 
CONTRACT, V, g', g") msg from w 

{checks the ehgibihty of contraction} 

if (IS-ELIGIBLE-CONTRACT, v, g' , g") / lastmsgu 

then 

if 3j/ € Nu with 'weightu[y\ 7^ and gy 7^ g' and gy 7^ 
g" then 

send(ELIGIBLE-CONTRACT, v, g') to each z £ 
with weightu[z] = or {weightulz] ^ and gz = g')- 
{See Algorithm 1161 for receipt of message} 
else 

send(IS-ELIGIBLE-CONTRACT, v, g' , g") to each 
z € Nu with weightu[z\ — and z ^ w 
end if 

lastmsgu ^ (IS-ELIGIBLE-CONTRACT, v, g' , g") 
end if 



Algorithm 16 upon receipt of (ELIGIBLE-CONTRACT, 
V, g') msg from w 

if (ELIGIBLE-CONTRACT, v, g') / lastmsgu then 
a u = V then 

stopu false 

contract 
else 

send(ELIGIBLE-CONTRACT, v, g') to each z e Nu, 
z ^ w with weightu[z] = or [weightulz] 7^ and 

5^ = g') 

end if 

lastmsgu ^ (ELIGIBLE-CONTRACT, v, g') 
end if 



Algorithm 17 upon receipt of (SET-GROUP-ID, g' , g" , 
newrank) msg from w 

{update group id of all vertices in the groups g' and g" by 
maxranku by sending messages} 
if gu 7^ newrank then 
weightu [w] 
check- act ive() 
gu newrank 
if statusu = ACTIVE then 

for all V G Nu with uieijr/ifu [w] 7^ do 

if 5„ = g' or <;„ = g" or (j,, = newrank then 
weightu [v] -f- 
check- act ive() 

send(SET- WEIGHT) to v. {See Algorithm [19] 
for receipt of message} 
end if 
end for 
end if 

send(SET-GROUP-ID, g' , g" , newrank) to each x £ 
Nu where weightu [x\ = 
end if 



Algorithm 18 synchronize() 

{waits for all nodes to reach the same step of algorithm} 
wait for n pulses 



Algorithm 19 upon receipt of (SET- WEIGHT) msg from 
w 

weightu[w\ <— 

check-active 



Algorithm 20 check-active() 

if Vw G Nu, weightu[v\ = then 

statusu = INACTIVE 
end if 



Algorithm 21 upon receipt of (STOP, t) msg from w 

{broadcast the information on the number of groups in 
the network} 

if (STOP, t)/ lastmsgu then 
ii t = false then 
stopu <— false 

send(STOP, t) to each x € Nu 
lastmsgu ^ (STOP, t) 
end if 
end if 



2.3 Correctness 

First, we bound the probabihty of error created by edges 
getting the same rank. 

Lemma 2.3.1. The probability that two edges get the same 
rank in n trials is 0{n^^). 

Proof. The rank is a value from the set {l...m'^}. The 
probability that two edges m and m' having the same rank, 
Pr[rank{m) = rank{m')] < ^ 
Hence, Pr[3{m,m') : rank{m) = rank{m')] < 
Y:(m,m')eBxE P^rankim) = rank{m')] = 
Thus, using the union bound, probability that there exists 
two edges m and m' having the same rank in n iterations 
is < < = Now choose A: > 5. Then, 

Pr[rank(m) = rank(rn')\ < ^ — 0{n^^). □ 

The following Lemma proceeds exactly as in [S|. 

Lemma 2.3.2. A particular min-cut in G is produced by 
the contraction algorithm with probability Q{n^'^). 

Proof. Let c be the value of the mincut in G. Each 
contraction reduces the number of vertices in the graph by 
one. Consider the contraction executed when the graph has 
r vertices. Since the contracted graph has a min-cut of at 
least c, it must have minimum degree c, and thus atleast ^ 
edges. However, only c of these edges are in min-cut. Thus, 
a randomly chosen edge is in the min-cut with probability at 
most ^. The probability that we never contract a min-cut 
edge through all n — 2 contractions is atleast (1 — -)(1 — 

^)(i-^)....(i-i) = (;r' = f^(-~') □ 



Algorithm 22 upon receipt of (LOCAL-MC, mcut, x, v) 
msg from w 

{computes mincut partially} 
if (LOCAL-MC, mcut, x, v)=^ lastmsQu then 
it u = V then 

mCu mCy, + mcut 
else 

send(LOCAL-MC, mcut, x, v) to each y € Nu 
end if 

lastmsQu (LOCAL-MC, mcut, x, v) 
end if 



Algorithm 23 upon receipt of (MINCUT, v, mincut) msg 

from w 

{broadcasts the mincut to all nodes} 

if (MINCUT, V, mincut)^ lastmsQu then 

mcu <— mincut 

send(MINCUT, v, mincut) to each y G 
lastmsQu ^ (MINCUT, v, mincut) 
end if 



2.4 Complexity Analysis 

2.4.1 Message complexity 

Theorem 2.4.1. The Karger's distributed algorithm uses 
O(mn^) messages, in a single trial. 

Proof. It is not hard to see that the most expensive steps 
in a trial are those of determination of maxrank from lo- 
cal maxranks(find-global-maxrank()) and that of computing 

the mincut at the end(find-global-mincut()). In find-global- 
maxrank(), each node sends its local maxrank value to its 
neighbours and this is repeated atmost n timcs(number of 
times equal to the diameter of the graph sufficies). Hence 
the total number of messages is bounded by nO{m + n) = 
0(mn). Thus the message complexity for n — 2 iterations per 
trial is Oirnn^). Finally, in step i of find-global-mincut(), 
~ nodes send messages to its neighbours. The total num- 
ber of messages sent at each step is bounded by 0(m). 
Thus, the total number of messages is S^^j"^ = 0{mn). 
Hence the overall message complexity is 0{mn'^) + 0{mn) = 
Oijnn^). □ 

2.4.2 Time complexity 

Theorem 2.4.2. The Karger's distributed algorithm com- 
putes mincut in 0{n^) time, in a single trial. 

Proof. Before contraction, the algorithm assigns a rank 
(random number) to each edge and finds the max-rank among 
all the vertices in the graph. This requires atmost n — 1 
steps(strictly, number of steps equal to the diameter of the 
graph). For contraction, a message is sent from a vertex 
within one group to other group and the message is prop- 
agated to all the vertices within the second group and the 
neighbouring vertices of that group, which also takes atmost 
n — 1 pulses. Since only one contraction can take place at 
any time and there are n — 2 such contractions, the running 
time is O(ri^). To estimate time for computing the mincut, 
the function find-global-mincut() runs O(logn) steps and in 
step i, ^ nodes flood the network. Thus the time per step 

is 1^. Hence the total complexity is ^^ii^"^ = Oin^). □ 



3. CONCLUSION AND FUTURE WORK 

A synchronous distributed version of the Karger's random- 
ized algorithm under network setting is presented in this 
paper with a proof of correctness and complexity analysis. 
The present algorithm appears not to make use of the full 
power of parallelism available. It is interesting to look at 
how to efficiently reduce time and message complexity by 
conducting edge contractions in parallel. 
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